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PREFACE 



The Bucks County Schools have for some time been committed to 
Improving the quality of the educational offerings for Its youth. Char- 
acteristic of that commitment was the manner In which officials of the 
Pennsylvania Department of Education, Bucks County Public Schools, Luzerne 
County Public Schools, Allegheny County Public Schools, Penn-Traf ford 
School District, Pittsburgh School District, and Erie School District 
joined together In 1966 to draft the proposal for the Quality Education 
Program Study (QEPS). Conceived as a complement to Pennsylvania's 
pioneering efforts to assess the quality of Its schools, the study was 
designed to define and clarify the Ten Goals of Quality Education adopted 
by the State Board of Education in 1965. 

The following booklet Is a part of the story of how Q.E.P.S. 
went about Its ambitious task, and the results of that effort. We trust 
this statement of the behavioral definitions for Pennsylvania's Ten Goals 
of Quality Education will serve as a guide for the evaluation and improve- 
ment of teaching and learning In the schools of the Commonwealth. 



Ill 




Dr. George E. Raab 
County Superintendent 
Bucks County Public Schools 



INTRODUCTION 



In recent years there has been an increased interest in goal 
definition in education. Most efforts toward the establishment and 
definition of goals seems to take the form of generalizations or descrip- 
tive statements. Little, if any, data is available concerning empirical 
methods for defining educational goals. 

Until recently, the "Goals for Quality Education 11 were not 
defined in a coherent form. An analysis of this problem revealed that 
most stated goals have little exact meaning for the practicing educator. 
Frequently, goals are stated in such general terms that any educator 
could convince himself that these goals are the purpose that guide his 
program. Goals are statements of general educational intents. While 
it is not absolutely necessary for goals to be stated in performance 
terms, the more clearly these statements are described, the more readily 
we can develop valid indicators of pupil behavior. 

The first step in constructing an instructional program centers 
upon the need for a set of objectives. An objective refers to the per- 
formance or change in behavior a pupil is to exhibit upon completion of 
instruction. Therefore, meaningful objectives should relate to the 
Goals for Quality Education**. If one is **to measure objectively the 
adequacy and efficiency*' of educational programs, these objectives must 
be described in terms of not what the schools d^, but in what children 
do. One must itemize the kinds of behavior that add up to the goals for 
quality education if we are ever to know how children progress toward the 
goals or how efficient an educational program may be in furthering such 



progress* Specifying goals in this way poses practical problems.* 

The formulation and adoption of Pennsylvania's Goals of Quality 
Education represents a major step toward the definition of the State's 
educational intents, making possible an assessment of its efforts toward 
the fulfillment of those intents. In an effort to further increase the 
utility of the goals to the practitioner and evaluator, the Quality 
Education Program Study was proposed to review, define, and clarify the 
Ten Goals. Funded in 1968 under E.S.E.A. Title III, Q.E.P.S. made a 
unique departure from the usual "armchair philosophy" or logical approach 
to goal definition by deciding to employ the Critical Incident Technique. 
This technique was used to collect empirical data to define the goals. 

The QEPS staff collected critical incident data from teachers, 
students, and parents from various urban, suburban, and rural areas 
throughout the State. These data included both student behaviors indi- 
cative of achievement of the Ten Goals and teacher behaviors effective 
in helping students achieve these Goals. 

The resulting descriptions or definitions for each of the Ten 
Goals include: (1) Student Behaviors, (2) Rationales or narrative ex- 

planations, and (3) Teacher Strategies. Also, for each Goal QEPS has 
developed needs assessment instruments to provide the practitioner with 
a mechanism to systematically gather information to assess its needs and 
assign priorities to those needs. 




1 Educational Testing Service. A Plan for Evaluatin g the Quality of 
Educational Programs in Pennsylvania. Volume One: The Basic 

Program. Princeton, New Jersey: ETS, Henry S. Dyer, Project 

Director, Chapter I, pages 1-4 (June 30, 1965). 
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It It hoped that the resulting products of three years of 
intensive work devoted to defining Pennsylvania's Ten Coals of Quality 
Education will provide various segamnts of the educational coasunlty 
with intonation and the swans to continue to lap rove the quality of 
education for the students of Pennsylvania. 



Raymond Be r ns be 1 
Assistant Superintendent 
Bucks County Schools 



Donald L. Wright 
Project Director, Q.E.P.S 



PROJECT REPORTS 



The following is a listing and brief description of the re* 
ports produced by the Quality Education Program Study: 



Booklet A 



Booklet B 



Booklet C 



Project Description 

A description of the project including a background 
and overview and n detailed report of procedures used 
to collect, handle, and analyse the data. Includes 
an appendices* 

General Needs Assessment 
Instructions 

General Needs Assessment Instrument for the Ten Goals* 

Characteristics of Incidents and Their Reporters 
Gives a tabulation of various characteristics of re* 
porters for each category and sub~category of student 
behavior* 



Goals One through Ten each have two reports* The first is 
a Description of the goals, containing three basic components: (1) 

the categories of student behavior, (2) rationales for the areas of 
effective student behavior, and (3) related teacher strategies, the 
second report Is related to the Needs Assessment of that goal and 
contains: (i) Instructions, (2) the general needs assessment instru* 

merit for that goal, and (3) an analysis of instruments related to 
that goal. The booklets for the Ten Goals are: 



Goal One * Self Understanding 



Booklet 

Booklet 


1 

1A 


Description 
Needs Assessment 

Goal Two «. Understanding Others 


Booklet 


2 


Description 


Booklet 


2A 


Needs Assessnent 






Goal Three * Basic Skills 


Booklet 


3 


Description 


Booklet 


3A 


Needs Assessment 





Goel Four - Interest In School and Learning 


Booklet Jt 


Peecrlptlon 


Booklet 4A 


Heeds Assessaent 

Coel Five - Good Cititensfclp 


Booklets 


Peecrlptlon 


Booklet 3A 


Weeds- Assessaent 

Coel Six - Good Health- Heblte 


Booklet 6 


PMCtfpt&SB 


Bookie t_6A 


Weeds_A«aeasnent 
Coal Seeen - Creativity 


Booklet? 


Peecrlptlon 


flflgfclSi-ZA 


Weeds Assessaent 

Goal Elaht * Vocational Pevelopoeent 


Booklet 8 


Peecrlptlon 


Booklet BA 


Weede Aeeeeeaent 

Coal Wine - Understanding Human Accooolishnents 


Booklet 9 


Peecrlptlon 


Bookie t_9A 


Weeds Assessaent 

Goal Ten * Preoaration for a World of Chance 


Booklet 10 


Peecrlptlon 


Booklet 1QA 


Weeds Assessaent 
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.. PURPOSE 
• * 

There are three purposes for this booklet* First is to report 
a simple description of the teachers that participated in the definition 
of the ten goals of Quality Education* These teachers are described in 
Table One, •'Teacher Summary Report for 1969 ,f * The second purpose is to’ 
report a simple description of the teachers that participated in the col- 
lection of teacher strategies* These teachers are described in Table Two, 
"Teacher Summary Report for 1970" 

In addition to a simple summary description of the samples of 
teachers who participated in the different project activities, another 
objective of the study was to describe the reporters '( teachers, students, 
and parents) that reported incidents in each category and sub-category of 
student behavior* 

Why report an analysis of this sort? The project has described 
over 1500 categories of behavior in the ten goals of education* Very early 
in the project, questions were asked like: What kind of teacher would re- 

port an incident about peaceful dissent? Young? Experienced? From an 
urban area? Would parents report this type of incident? 

The answers to these questions are simply a compilation and anal- 
ysis of the incidents that were collected in the project* Any attempt to. 
generalise to the general population of teachers, students, and parents 
of the Commonwealth of Pennsylvania should be done with caution because 
of the sampling procedures used in the project. 




It 

.-'i: 

;VV 

Tmllfr Hanortg for 1969. and 1970 

♦£* * 

Table 1 summarizes the characteristics of the teachers who con- 
tributed incidents of student behavior. Table 2 summarizes these sane 
characteristics for teachers who contributed incidents of teacher behavior 
used in the determination of teacher strategies. The grand totals for each 
characteristic are not necessarily equal because of uncouple te data. Ten 
major categories account for the ways in which the characteristics of the 
sample of teachers are described. 



1 . 

2 . 

3. 

4. 

5. 



1 . 

2 . 

3. 

4. 

5. 

6. 

7. 



Geographic Area 

Allegheny County (includes several Beaver and 
Westmoreland County Schools) 

Pittsburgh City 

Erie City and County 

Bucks County 

Luzerne County 

Orban. Suburban. Rural 
Open country or farming community 
Snail town, not a suburb (leas than 10,000) 
Medium sire city (10,000 * 100,000) 

Suburb of medium size city 
Large city (100,000 - 500,000) 

Suburb of large city 

Very large city (over 500,000) 

Suburb of a very large city 




*2* 
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8 



The rest of the categgrites should be self-explanatory* Overall 
they include sex, marital status, age, race, years teaching within the 
district, total teaching experience, level of education, and certification* 
Table 3 contains a list of public and private schools that con- 
tributed to the study* 
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TABLE 1 



TEACHER SUMMARY REPORT FOR 1969 



CATEGORY 

Geographic Area: 

Allegheny 

Pittsburgh 

Erie 

Bucks 

Lucerne 

Total 

Urban, Suburban, Rural: 

1. Open country or fanning 
community. 

2. Small town, not a suburb 
(less than 10,000). 

3. Medium size city (10,000 - 

100 , 000 ). 

A. Suburb of medium size city. 

5. Large city (100,000 - 
500,000). 

6. Suburb of large city. 

7. Very large city (over 
500,000). 

8. Suburb of a very large 
city. 



5 


GRADES 

8 


11 


TOTAL 


A2 


56 


49 


147 


21 


20 


20 


61 


21 


16 


18 


55 


5A 


56 


35 


145 


-M 


Jil 


_50 


155 


196 


195 


172 


563 



28 


25 


16 


69 


47 


52 


21 


120 


25 


34 


37 


96 


29 


24 


31 


84 


21 


16 


18 


55 


0 


0 


0 


0 


0 


0 


0 


0 


5 


10 


16 


31 


155 


161 


139 


455 
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3 



34 



Total 



TEACHER SU MMARY REPORT FOR 1969 
CATEGORY GRADES 





5 


8 


11 


Sex: 


Male 


45 


86 


92 


Female 


147 


102 


67 


Marital Status: 


Divorced 


3 


2 


2 


Married 


115 


112 


97 


Single 


71 


70 


59 


Age: 


0-25 


46 


66 


30 


26-30 


40 


33 


30 


31-35 


15 


18 


28 


36-40 


10 


10 


15 


41-45 


18 


14 


10 


46-50 


15 


15 


18 


51-55 


17 


7 


16 


56-60 


15 - 


9 


9 


over 60 


19 


17 


6 


Race: 


Spanish 


0 


0 


1 


Other White 


187 


180 


155 


Hegro 


6 


6 


4 




i 

I 

i 

I 

\ 

\ 
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TEACHER SUMMARY REPORT FOR 1969 



CATEGORY GRADES 



Years Teaching in District: 


5 


8 


0-3 


86 


90 


4-10 


58 


58 


11-20 


27 


20 


21-30 


7 


13 


31-40 


13 


6 



Years Teaching Experience: 
0-3 
4-10 
11-20 
21-30 
31-40 

Level of Education: 



Standard 


23 


4 


Bachelors 


76 


80 


Bachelors + 15 


53 


46 


Masters 


31 


37 


Masters + 15 


5 


16 


Masters + 30 


3 


5 


Doctorate 


0 


0 



48 63 

76 59 

30 35 

17 12 

17 11 




U 
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TEACHER SUMMARY REPORT FOR 1969 



CATEGORY 




GRADES 






5 


8 


11 


Certification: 








Elementary 


169 


22 


8 


Math 


6 


37 


32 


Science 


10 


48 


36 


Social Studies 


36 


57 


68 


Language 


21 


53 


51 


Art, Music 


11 


18 


11 


Phys, Ed, 


8 


11 


16 


Foreign Language 


4 


17 


24 


Other 


32 


38 


43 



i 

f 



i 



i 

i 



I 

i 
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TABLE 2 



C ATEGOR Y 

Geographic Area: 

Allegheny 

Pittsburgh 

Erie 

Bucks 

Luzerne 

Total 

Urban, Suburban, Rural: 

1* Open country or farming 
community* 

2* Small town not a suburb 
(less than 10,000)* 

3* Medium size city (10,000 ~ 

100 , 000 ). 



5* Large city (100,000 - 
500,000). 

6* Suburb of large city* 

7* Very large city (over 
500,000). 

8* Suburb of a very large 
city. 

Total 



IE AC HER S UM M A RY BEP.QRI f Q R 1 27 Q 

GRADES 



TOTAL 



5 


8 


11 




375 


174 


204 


753 


104 


24 


68 


196 


95 


55 


30 


180 


487 


61 


15 


563 


182 


_85 


lii 


2 86 


1243 


399 


436 


2078 


117 


65 


60 


242 


334 


68 


26 


428 


131 


32 


51 


214 


92 


48 


52 


192 


42 


30 


14 


86 


166 


21 


15 


202 


20 


10 


18 


48 


72 


22 


19 


113 


974 


296 


255 


1525 



o 

ERIC 



.•338 



XEAC.HKR- SUMMARY REPORT FOR 1970 



CATEGORY 




GRADES 






5 


8 


11 


Sex: 


Male 


173 


157 


150 


Female 


946 


182 


173 


Marital Status: 


Divorced 


18 


2 


6 


Married 


693 


193 


195 


Single 


395 


139 


117 


Age: 


0-25 


332 


109 


52 


26-30 


187 


69 


52 


31-35 


77 


35 


31 


36-40 


93 


31 


41 


41-45 


76 


21 


39 


46-50 


90 


19 


38 


51-55 


72 


20 


22 


56-60 


75 


16 


23 


over 60 


127 


19 


30 


Race: 


Spanish 


1 


2 


0 


Other White 


998 


318 


317 


Negro 


17 


3 


5 


Chinese, Japanese, Korean 


0 


0 


0 


Ind inn 


* 

J. 


0 


0 


Other 


339 


1 


1 



o 
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TEACHER SUMMARY REPORT FOR 1970 



CATEGORY 




grades 






5 


8 


11 


Yearr Teaching in JHstrict: 








0-3 


4 97 


159 


99 


4 10 


341 


110 


110 


11-20 


If 3 


46 


62 


21-30 


65 


16 


33 


31-40 


41 


5 


20 


Years Teaching Experience: 








0-3 


322 


108 


55 


4-10 


374 


116 


109 


11-20 


213 


73 


77 


21-30 


125 


24 


52 


31-40 


70 


12 


28 


Level of Education: 








Standard 


114 


8 


6 


Bachelors 


445 


127 


72 


Bachelors + 15 


316 


97 


78 


Masters 


169 


67 


98 


Masters + 15 


46 


20 


37 


Masters + 30 


30 


18 


34 


Doctorate 


1 


0 


0 




also 



I 



TEACHER SUMMARY REPORT FOR 1970 
CATEGORY CRAPES 





5 


8 


Certification: 






Elementary 


1029 


70 


Math 


41 


47 


Science 


50 


60 


Social Studies 


127 


100 


Language 


97 


93 


Art, Music 


35 


24 


Phys, Ed, 


25 


27 


Foreign Language 


24 


30 


Other 


16 


18 



o 




11 

24 

48 

63 

133 

132 

17 

18 

51 

17 



341 



TABLE 3 

LIST OF PARTICIPATING SCHOOLS 



ALLEGHENY COUNTY 

Public School Districts 

Bellevue Borough 
Chartiers Valley 
Clairton City 
Elizabeth Forward 
North Allegheny 
South Fayette Township 
Upper St* Clair Township 
West Jefferson Hills 



BEAVER COUNTY 

Public School Districts 

Ambridge Area 
Baden Economy 
Blackhawk 
New Brighton Area 



BUCKS COUNTY 

Public School Districts 

Bristol Borough 
Bristol Township 
Centennial 
Central Bucks 
Council Rock 
New Hope-Solebury 
Palisades 
Pennridge 
Pennsbury 
Quaker town 



Slocese of Pittsburgh 

Our Lady of Grace 
Resurrection 
Saint Agatha 
Saint Joseph 
Saints Simon and Jude 
South Side Catholic 
High School 



Archdiocese of Philadelphia 

Archbishop Wood Boys 
High School 
Archbishop Wood Girls 
High School 



ERIE COUNTY 

Public School Districts 

Fort Le Boeuf 
Millcreek Township 



Diocese of Erie 

Blessed Sacrament School 
Our Lady's Christian 
Saint Andrew 
Saint Patrick 
Villa Maria Academy 





LIST OF PARTICIPATING SCHOOLS 



LUZERNE COUNTY 

Public School Districts 

Dallas 

Hanover Township 
Lake Le liman 
Northwest Area 
Wilkes Barre City 
Wyoming Valley West 



Diocese of Scranton 

Central Catholic 
Cate of Heaven 
Marynount High School 
Nativity of B.V.M. 

St. Aloysius 
St. Ann's Academy 



WESTMORELAND COUNTY 

Public School District 

Penn Trafford 



CITY OF ERIE 



Private Schools 



Erie City School District 



Community Country Day 
School 

Erie Day School 



CITY OF PITTSBURGH 



Pittsburgh City School District 



Private Schools 

St. Edmund's Academy 
Shady Side Academy 
The Ellis School 



O 
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PROCEDURES FOR OBTAINING CHARACTERISTICS OF INCIDENTS AND THEIR REPORTERS 



When incidents were collected from teachers, students and par- 
ents, additional data about the incident and its reporter were also gath- 
ered* The data that was gathered was decided upon early in the project 
through the identification of questions of interest. These data are pre- 
sented in the next section entitled “Questions of Interest." 

After all incidents were classified by goal, category and sub- 
category, the data for each incident and reporter was keypunched for com- 
puter use. Frequency counts for each type of data were obtained for each 
category and sub -category. The Honeywell H-1200 computer of the Bucks 
County Public Schools, Doyles town, Pennsylvania was used to obtain all 
frequency counts. 



QUESTIONS OF INTEREST 



A number of variables were considered important to collect from 
the beginning of the student behavior collections. From each teacher that 
participated in the study the following data were collected: 



(1) 


County 


(2) 


District 


(3) 


Grade level taught 


(A) 


Sex of teacher 


(5) 


Marital status - married, single, or divorced 


(6) 


Racial Ethnic -- Spanish, Other White, Negro, Chinese, 
Japanese, American Indian 


(7) 


Age 


(8) 


Years in the current district 


(9) 


Total years teaching experience 


(10) 


Education - standard certificate, bachelors degree, bache- 
lors + 15 credits, masters degree, masters + 
15 credits, masters + 30 credits, doctors de- 
gree 


(11) 


Types of certification - elementary, mathematics, science, 

social studies, language arts, art- 
music, physical education-health, 
foreign language 


(12) 


Sex of student reported 


(13) 


Subject in which the incident took place 



A smaller number of data were recorded for each incident re- 
ported by a student: 



(i) 


County 


(2) 


School district 


(3) 


Grade level of student reporter 


(4) 


Sex of student reporter 


(5) 


Subject in which the incident took place 



Finally the data for the parents* reports of student behaviors 
consisted of: 

(1) County 

(2) District 

(3) Sex of parent 

(4) Grade level of student in the incident 

(3) Sex of student in the incident 

The variables just listed provided the ways in which frequency 
counts were made. One additional variable was obtained by classification 
of each district according to the urban-suburban-rural scheme used by the 
Bureau of Quality Assessment, Department of Education, Harrisburg, 
Pennsylvania, 

1. In the open country or in a farming community. 

2. In a small town (less than 10,000 people) that is not a 
suburb. 

3. Inside a medium size city (10,000-100,000 people). 

4. In a suburb of a medium size city. 

5. Inside a large city (100,000-300,000 people). 

5, In a suburb of a large city. 

7. In a very large city (over 500,000 people), 

8. In a suburb of a very large city. 

Complete tabulation for each of the above variables is presented 
in the Supplement to Booklet C. 
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SUGGESTIONS FOR FURTHER RESEARCH 

How to Use Tables for Further Hypothesis Generation 

As was indicated in the "Purpose" section earlier many questions 
arise when examining the categories of behavior. Was it reported by par- 
ents, students, and teachers? What kind of teachers would report incidents 
of student behavior in this category? Young? Experienced? Male? 

Certainly one task that remains to be done in obtaining a clearer 
understanding of the goals, and the behaviors that make up the goals of 
education is to look at the types of people who value the different cate- 
gories of behavior. 

By looking at categories of behavior that are important to the 
reader and looking at the characteristics of the people who reported in- 
cidents of that category, a certain amount of insight is obtained. 




0 



Sample of Hypothesis Generation 



For the purpose of this booklet Goal 1 Area 1 will be examined 
in some detail. Goal 1 deals with Self-Understanding and Area 1 specif- 
ically deals with behaviors in fchich a student demonstrated competency or : 
a willingness to test his competency by attempting a task. 

Let's first look at categories not reported by teachers, stu- 
dents, and parents (see Table 4). Only one category (1.8) is not reported | 
by teachers. This category (student played a musical instrument (other 
than in a class or public presentation)) is probably not too significant 
except that it is outside the normal school setting. By referring to the 
S/S collection section of the Supplement, one finds four incidents of this 
sort all reported at the fifth grade level. 

Quite a number of sub-categories are reported by only teachers, j 
Category 1.3 and its sub-categories provide an example of this. Signifi- 
cantly, at the category level incidents were contributed by teachers, stu- 
dents and teachers. 

Category 1.1 and sub-category 1.1-1 are both reported by only 
teachers and students, but they are both concerned with a contribution 
to class discussion. It is quite understandable why parents might not 
report incidents like this, since they are not present in the classroom 
setting. 

Further analysis of the teachers reporting incidents in this 
category and sub-category (see T/S collection reports number 1 and 2 of 
reporter information in the Supplement) tend to have less than ten years 
experience and were also among the younger teachers. There were a smaller 
number of the more experienced teachers that also report incidents of this 
sort. Host of the incidents were also reported in grades eight and eleven. 
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One of the other uses to which the categories of student be- 
havior might be put is to develop test instruments for the assessment of 
achievement of the goals, Certainly the type of analysis just presented 
should be considered in the process of developing test instruments. 
Clearly the insight gained is necessary for meaningful test item develop- 
ment. 
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TABLE 4 



o 

ERIC 



GOAL 1 AREA 1 

T“ 

Categories and Sub-categories 
and Who Reported Incidents 



1.1 T S 

1.1-1 T S 

1.2 T S P 

1.3 T S P 

1.3- 1 T 

1.3- 2 T 

1.3- 3 T 

t i 

1.3- 4 T S P 

1.4 T S 

1.4- 1 T 

1.4- 2 T S 

1.5 T S P 

1.6 T S P 

1.7 T S 

1.7-1 T S P 

1.8 S 

1.9 T 

1.9- 1 T S P 

1.9- 2 T S 

1.10 T S P 

1.10- 1 T 

1.10- 2 T 

1.10- 3 T 




* 



1. 1,0-4 

1.10- 5 

1.11 

1 . 11 - 1 

1 . 11-2 

1.11- 3 

1.11- 4 

1.12 

1 . 12 - 1 

1 . 12-2 

1.13 

1.14 

1.14- 1 

1.14- 2 

1.14- 3 

1.15 

1.15- 1 

1.15- 2 

1.15- 3 



T 

T S P 
T S 
S P 
X S 
S 

X S 
T 

X S P 
ISP 
ISP 
I S 
I S 
S P 
ISP 
ISP 
ISP 
S 
T 
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ORGANIZATION OF TABLES IN SUPPLEMENT TO BOOKLET C 



The overall organization of this supplement is to include all 

data for each goal together. To achieve this each section is organized 

? • 

as follows: 



Report Name 

Effective 



Teacher 


T/S Collection 


Teacher 


Report #1 of Reporter Information 


Teacher 


Report #2 of Reporter Information 


Student 


S/S Collection 


Student 


Report of Urban, Suburban and 




Rural Categories 


Parent 


P/S Collection 


Parent 


Report of Urban, Suburban and 



Rural Categories 



Ineffective 

Teacher T/S Collection 

Teacher Report #1 of Reporter Information 

Teacher Report #2 of Reporter Information 



i 

j 

Category number in the first column consists of a six digit num- 
ber. The first two are the area number; the middle two the category num- 
ber; and the last two are the subcategory number. Thus 030204 corresponds 
to 3.2-4 as found in Booklets 1-10; 030200 would be 3.2 (the 00 indicating 
no subcategory). Note that 000100 are incidents clearly related to the 
goal but uncategorized and that 000200 are incidents which appear not to 
be related to the goal and thus uncategorized. j 
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